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Abstract: Neural networks are powerful universal approximation tools. They have been utilized for 
functions /data approximation, classification, pattern recognition, as well as their various applications. 
Uncertain or interval values result from the incompleteness of measurements, human observation 
and estimations in the real world. Thus, a neutrosophic number (NsN) can represent both certain 
and uncertain information in an indeterminate setting and imply a changeable interval depending 
on its indeterminate ranges. In NsN settings, however, existing interval neural networks cannot 
deal with uncertain problems with NsNs. Therefore, this original study proposes a neutrosophic 
compound orthogonal neural network (NCONN) for the first time, containing the NsN weight 
values, NsN input and output, and hidden layer neutrosophic neuron functions, to approximate 
neutrosophic functions/NsN data. In the proposed NCONN model, single input and single 
output neurons are the transmission notes of NsN data and hidden layer neutrosophic neurons 
are constructed by the compound functions of both the Chebyshev neutrosophic orthogonal 
polynomial and the neutrosophic sigmoid function. In addition, illustrative and actual examples 
are provided to verify the effectiveness and learning performance of the proposed NCONN model 
for approximating neutrosophic nonlinear functions and NsN data. The contribution of this study 
is that the proposed NCONN can handle the approximation problems of neutrosophic nonlinear 
functions and NsN data. However, the main advantage is that the proposed NCONN implies a 
simple learning algorithm, higher speed learning convergence, and higher learning accuracy in 
indeterminate/NsN environments. 


Keywords: Neutrosophic compound orthogonal neural network; Neutrosophic number; 
Neutrosophic function; Function approximation 


1. Introduction 


Neural networks are powerful universal approximation tools. They have been utilized for data 
modeling, function approximation, classification analysis, pattern recognition, as well as their various 
applications. Uncertain or interval values result from the incompleteness of measurements, human 
observation and estimations in the real world. Hence, Baker and Patil [1] proposed an interval neural 
network (INN), which used interval weights rather than interval data input to approximate an interval 
function. Then, Hu et al. [2] presented an INN with interval weights, where the network is modeled 
like the problem of the solution equations, implying its complexity in the solution process. Rossi 
and Conan-Guez [3] introduced a multilayer perceptron neural network on interval data for the 
classification analysis of interval data. For processing the interval neural network, Patifio-Escarcina [4] 
presented an INN, where one of its input, output, and weight sets is interval values and the output set 
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is a binary one, therefore its outputs are binaries too for classifiers. Recently, Lu et al. [5] introduced a 
neural network-based interval matcher corresponding to linguistic IF-THEN constructions, which is an 
interval pattern matcher to identify patterns with interval elements using the neural network, which 
can handle interval inputs values and interval output values based on a traditional neural network 
and is only suitable for interval pattern matching. Kowalski and Kulczycki [6] presented the interval 
probabilistic neural network (IPNN) for the classification of interval data, where the IPNN structure is 
based on Specht’s probabilistic network [7]. 

In indeterminate environments, neutrosophic theory [8-10] has been used for various 
applications [11-14]. Since a neutrosophic number (NsN) [8-10] can represent both certain and 
uncertain information in indeterminate settings and contain a changeable interval depending 
on its indeterminate ranges, NsNs have been wildly applied to decision making [15-17], fault 
diagnoses [18,19], linear and nonlinear optimization problems [20-23], expression and analysis of the 
rock joint roughness coefficient JRC) [24-27]. However, there is no study on neutrosophic neural 
networks with NsNs in existing literature, while existing INNs also cannot deal with uncertain 
problems with NsNs. Therefore, this original study proposes a neutrosophic compound orthogonal 
neural network (NCONN) for the first time, which contains the NsN weight values, NsN input and 
output neurons and hidden layer neutrosophic neurons, to approximate neutrosophic functions and 
NsN data. In the proposed NCONN model, single input and single output data are NsNs (changeable 
interval numbers) and hidden layer neutrosophic neuron functions are composed of the Chebyshev 
neutrosophic orthogonal polynomial and neutrosophic sigmoid function. In addition, illustrative and 
actual examples are provided to verify the effectiveness and performance of the proposed NCONN 
model in approximating neutrosophic nonlinear functions and NsN data. The contribution of this study 
is that the proposed NCONN can handle the approximating and modelling problems of neutrosophic 
functions and NsN data for the first time. The main advantage is that the proposed NCONN implies 
a simple learning algorithm, higher speed learning convergence, and higher learning accuracy in 
indeterminate/NsN environments. 

This study was formed as the following framework. The second section introduces the basic 
concepts and operations of NsNs. The third section proposes a NCONN structure and its learning 
algorithm. Then, two illustrative examples about neutrosophic nonlinear function approximations 
and an actual example (a real case) about the approximation problem of rock JRC NsNs are presented 
in the fourth section and the fifth section, respectively, to verify the effectiveness and performance 
of the proposed NCONN in approximating neutrosophic nonlinear functions and NsN data under 
indeterminate/NsN environments. The last section contains conclusions and future work. 


2. Basic Concepts and Operations of NsNs 


In an uncertain setting, Smarandache [8-10] introduced the NsN concept represented by the 
mathematical form N =c + ul for a, b € R (all real numbers) and I (indeterminacy), in which the certain 
part c with its uncertain part ul for I € [I~, I*] are combined. Hence, it can depict and express the 
certain and/or uncertain information in indeterminate problems. 

Provided there is the NsN N = 5 + 3I, it depicts that the certain value is five and its uncertain 
value is 3]. Then, some interval range of the indeterminacy I € [I~, I*] is possibly specified in actual 
applications to satisfy some applied requirement. For instance, the indeterminacy I is specified as such 
a possible interval I € [0, 2]. Thus, it is equivalent to N = [5, 11]. If I € [1, 3], then there is N = [8, 14]. It 
is obvious that it is a changeable interval depending on the specified indeterminate range of I € [I~, I*], 
which is also denoted by N = [c+ ul~,c + ul*]. 

In some special cases, a NSN N =c + ul for N € U (U is all NsNs) may be represented as either a 
certain number N = c for ul = 0 (the best case) or an uncertain number N = ul for c =0 (the worst case). 
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Provided that there are two NsNs Ny =c, + uJ and N2 = cp + Uy! for Ny, No € UandIe€ [I-, I*], 
then their operational laws are introduced as follows [21]: 


Ny + No =cy +02 + (uy + U2)I = [ey 02 +I + uel ,cy +02 + ut F ug I*] (1) 


Ny — No = cy — co + (uy — U2) = [ey — co +l — ul, cy — cp + It — up I*] (2) 


Ny X No = cyco + (cy U2 + Cou,)I + Uy Uy I? 


a (cy + uyzI~ )(c2 + uzI~), (cy + uyzI~ )(c2 + ult), 
_ (ey Ptgl eco ital) (cy big lca it) (3) 
ae (cy +uyI~ )(cz + ugI~), (cy + ul )(co + u2I*), 
(cy + uyI*) (co + ual), (C1 + u1I*) (co + ual*) 


Ny y+ ul _ [cy + uy4I7,cy +u4I™ 
No C2 + ugI [co a UgI—, Co + UugIt 
min cy tu, I~ cy +uy,I— cytuyI™ cy tu It (4) 
Cotugl*’ cotugl—/ cotugl*’ cotugl— )/ 
cytuyl~ cytuyI~ cytuylt cytuyit 
CotugI*’ co+ugl—~’ cotuglt’ co+ugl— 


max 


Regarding an uncertain function containing NsNs, Ye [21,22] defined a neutrosophic function inn 
variables (unknowns) as y(x, I): U" + U for x = [x1,x2,...,%n]' € U" and I € [I-, I*], which is then a 
neutrosophic nonlinear or linear function. 

For example, y;(x,I) = Nixcos(x) = (cy + u,I)xcos(x) for x € Uand!I € [I', It] isa 
neutrosophic nonlinear function, while y2(x, I) = Nyx, + Nox, + N3 = (ci + uwi1)xy + (c2 + u2l) x5 + 
(cz + ugI) for x = [x1, x2]'€ U* andI € [I-, I*]isa neutrosophic linear function. 

Generally, the values of x and y(x) are NsNs (usually, but not always). 


3. NCONN with NsNs 


This section proposes a NCONN structure and its learning algorithm based on the NsN concept 
for the first time. 

A three-layer feedforward NCONN structure with a single input, single output, and hidden layer 
neutrosophic neurons are indicated in Figure 1. In Figure 1, the weight values between the input layer 
neuron and the hidden layer neutrosophic neurons are equal to the constant value 1 and the NsN 
weight values between the hidden layer neutrosophic neurons and the output layer neuron are w; 
G=1,2,... ,p); xp (kK =1,2,... ,n) is the kth NsN input signal; y; is the kth NsN output signal; and p is 
the number of the hidden layer neutrosophic neurons. 


Hidden layer 
neutrosophic neurons 


Input layer neuron Output layer neuron 


Xk Vk 


Figure 1. A three-layer feedforward neutrosophic compound orthogonal neural network 
(NCONN structure). 
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In the learning process, when each NsN input signal is given by xg = cy + ul = [cp + gl” ce + 
uxt] (k=1,2,...,n) for Ie [I-, I], the actual output value is given as: 


P 
Ve= ow aaa (5) 
j=l 


where the neutrosophic neuron functions of the hidden layer qj forj=1,2,...,p are the Chebyshev 
compound neutrosophic orthogonal polynomial: q; = [1, 1], q2 = X, qj = 2X + qj-1 — qj-2, and X is 
specified as the following unipolar neutrosophic sigmoid function (the neutrosophic S-function): 


x 1 


X= soa (6) 


The neutrosophic S-function can transform NsN into the interval (0, 1) and the different scalar 
parameters of « can change the slant degree of the neutrosophic S-function curve. 

Then, the square interval of output errors between the desired output yf = e + ul] and the actual 
output y, = c, + u,I for I € [I, I*] is given as follows: 


es _ 2 2 
ER = [(ch + ufl~ — cy — ul), (cf tug — cy — ult) ] (7) 


Whereas, the learning performance index of the proposed NCONN is specified as the 
following requirement: 


14 x 
The NCONN weight values can be adjusted by the following formula: 
Wy (1 +1) = Wy(1) + AE.Q,k =1,2,...,0 (9) 


where W;(1) = [#1 (I), @2(I),...,@q(D]" and Q,(L) = [71 ()), G2()),-.-,Fp(D]" is the NsN weight vector 
and the function vector of the hidden layer neutrosophic neurons, A is the learning rate of the NCONN 
to determine the convergence velocity for A € (0, 1), and / is the /th iteration learning of the NCONN. 

Thus, this NCONN learning algorithm can be described below: 

Step 1: Give W;(0) by small random values, 

Step 2: Input a NsN and calculate the actual output of a NCONN based on Equations (5) and (6), 

Step 3: Calculate the output error by using Equations (7) and (8), 

Step 4: Adjust weight values by using Equation (9), 

Step 5: Input the next NsN and return to Step 2. 

In the NCONN learning process, the learning termination condition depends on the requirement 
of the specified learning error or iteration number. 

Since NsN can be considered as a changeable interval depending to its indeterminacy I € [I~, I*], 
the learning algorithm of NCONN permits changeable interval operations, which are different from 
existing neural network algorithms and show its advantage of approximating neutrosophic nonlinear 
functions/NsN data in an uncertain/NSN setting. 

Generally, the more the hidden layer neutrosophic neurons are, the higher the approximation 
accuracy of the proposed NCONN is. Then, the number of the hidden layer neutrosophic 
neurons determinated in actual applications will depend on the accuracy requirements of actual 
approximation models. 


4. NsN Nonlinear Function Approximation Applied by the Proposed NCONN 


To prove the effectiveness of approximating any neutrosophic nonlinear function based on the 
proposed NCONN model, we present two illustrative examples in this section. 


Symmetry 2019, 11, 147 5 of 9 


Example 1. Supposing there is a neutrosophic nonlinear function: 
yi(x, 1) =1+0.3I + (0.5 + 0.21) x cos(7x) for I € [0, 1). 


For x € [—1+0.02I, 1+0.023]] and I € [0, 1], the proposed NCONN needs to approximate the above 
neutrosophic nonlinear function. 

To prove the approximation ability of the proposed NCONN, we give the proposed NCONN 
structure with eight hidden layer neutrosophic neurons (p = 8) and learning parameters, which are 
indicated in Table 1. 


Table 1. The NCONN structure and learning parameters. 


The Number of the Specified ~ 
, . E 
Learning Iteration 


1x8x1 2.5 0.25 20 [3.2941, 8.5088] 


NCONN Structure (og A 


Then, the desired output y1¢ = [y;,,y{,] and actual output y; = [y;,y]] of the proposed 
NCONNsS are shown in Figure 2. Obviously, the desired output curves and the actual output curves 
were very close to each other, to demonstrate the better approximation accuracy in the neutrosophic 
nonlinear function approximation of the proposed NCONN. Hence, the proposed NCONN indicated 
the better approximation performance regarding the neutrosophic nonlinear function. 


2.2 


ly}: Yq] 
a 


( 


Y4 
2 


0.44 & °e 


0.2 | | | | 
-1 -0.5 0 0.5 1 1.5 


x=[x", x*] 
Figure 2. The desired output yiq = [y,,/¥;,] and actual output y; = [y; , yj | of the proposed NCONN. 


Example 2. Considering a neutrosophic nonlinear function: 

y2(x,1) = (0.6 + 0.31) sin(7tx) + (0.3 + 0.151) sin(37x) + (0.1 + 0.051) sin(5ztx) for I € [0, 1]. 

For x € [0 + 0.0021, 1 + 0.002] and I € [0, 1], the proposed NCONN needs to approximate the 
above neutrosophic nonlinear function. 

To prove the approximation ability of the proposed NCONN model, we also give the NCONN 
structure with eight hidden layer neutrosophic neurons (p = 8) and learning parameters, which are 
indicated in Table 2. 
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Table 2. The NCONN structure and learning parameters. 
NCONN Structure a A ane clogs ete SP co E 
Learning Iteration 
1x8xil 8 0.3 20 [0.5525, 1.1261] 


Thus, the desired output y>7 = [y5,, Y3,] and actual output y2 = [y3 ,y3 | of the proposed NCONN 
are indicated in Figure 3. It was obvious that the desired output curves and the actual output curves 
were also very close, so as to demonstrate the better approximating accuracy and performance in the 


neutrosophic nonlinear function approximation of the proposed NCONN. 
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Figure 3. The desired output yy, = [y3,/Y3,] and actual output yz = [yz ,y3 | of the proposed NCONN. 


Corresponding to the learning results obtained from the above two illustrative examples, we 
could see that the proposed NCONN showed faster learning velocity and a higher learning accuracy, 
which indicated a better approximation performance regarding the neutrosophic nonlinear functions. 


5. Actual Example on the Approximation of the JRC NsNs Based on the Proposed NCONN 


In rock machanics, the JRC of rock joints implies uncertainty in different sampling lengths and 
directions of rock joints. Therefore, JRC uncertainty may make the shear strength of joints uncertain 
because of the corresponding relationship between JRC and the shear strength, which results in the 
difficulty of making assessments of side stability [25-27]. However, the lengths of the testing samples 
can affect JRC values, which indicates their scale effect. To establish a relationship between the 
sampling lengths L and the JRC values in an uncertain/NSN setting, existing literature [25-27] used 
the uncertain/neutrosophic statistic method and fitting functions to establish some related model of L 
and the JRC. Since the proposed NCONN is able to approximate NsN data, the proposed NCONN 
could be applied to the relative approximation model between the sampling length L and the NsN 
data of the JRC by an actual example (a real case) in this section, to show its effectiveness. 

According to the testing samples of the specified area in Shaoxing city, China and data analysis, 
we found a relationship between the sampling length L and the NsN data of JRC, which are shown 


in Table 3. 
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Table 3. NsN data of rock joint roughness coefficient JRC) regarding different sampling lengths for 


Te [0,1]. 
Sample Length L (cm) Xk JRC Yk 
9.8 + 0.41 [9.8, 10.2] 8.321+6.2311  — [8.321, 14.552] 
19.8 + 0.41 [19.8, 20.2] 7.970 + 6.4191 — [7.970, 14.389] 
29.8 + 0.AT [29.8, 30.2] 7.765 + 6.5291 — [7.765, 14.294] 
39.8 + 0.4 [39.8, 40.2] 7.762 + 6.4641 = [7.762, 14.226] 
49.8 + 0.41 [49.8, 50.2] 7.507 + 6.641 [7.507, 14.147] 
59.8 + 0.4 [59.8, 60.2] 7417+ 6.7141 = [7.417, 14.131] 
69.8 + 0.4 [69.8, 70.2] 7.337 + 6.7581 —-[7.337, 14.095] 
79.8 + 0.AT [79.8, 80.2] 7.269 + 6.7941 —-[7.269, 14.063] 
89.8 + 0.4T [89.8, 90.2] 7.210 + 6.8261 —_[7.210, 14.036] 
99.8 + 0.4T [99.8, 100.2] 7.156+ 6.8551 — [7.156, 14.011] 
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To establish the approximation model of the proposed NCONN regarding the actual example, we 
took the NCONN structure with eight hidden layer neutrosophic neurons (p = 8) and indicated the 


learning parameters in Table 4. 


Table 4. The NCONN structure and learning parameters regarding the actual example. 


NCONN Structure a 


A 


The Number of the Specified 


Learning Iteration 


E 


1x8x1 8 Is 


0.11 


5 


[3.2715, 22.3275] 


From Figure 4, we can see that the proposed NCONN could approximate the JRC NsN 
data regarding different sampling lengths L and showed a higher speed convergence and higher 
approximating accuracy in its learning process for the actual example. Obviously, the proposed 
NCONN could find the approximating model between different sampling lengths L and JRC NsN 


data, while existing neural networks cannot do them in the uncertain/NSN setting. 


15 t 


14 


13+ 


12 


11h 


ly’, y"] (JRC) 


y= 


10} 


Figure 4. The proposed NCONN approximation results of the JRC NsN data regarding different 


sampling lengths L. 
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6. Conclusions 


In a NSN setting, this original study presented a NCONN to approximate neutrosophic 
functions/NsN data for the first time. It is a three-layer feedforward neutrosophic network structure 
composed of a single input, a single output, and hidden layer neutrosophic neurons, where the single 
input and single output information are NsNs and hidden layer neutrosophic neuron functions are 
composed of both the Chebyshev neutrosophic orthogonal polynomial and the neutrosophic sigmoid 
function. Illustrative and actual examples were provided to verify the effectiveness and rationality of 
the proposed NCONN model for approximating neutrosophic nonlinear functions and establishing 
the approximation model of NsN data. Therefore, the contribution of this study is that the proposed 
NCONN could handle the approximating and modeling problems of uncertain/interval /neutrosophic 
functions and NsN data. Here, the main advantage is that the proposed NCONN implies a 
simpler learning algorithm, higher speed learning convergence, and higher learning accuracy in 
indeterminate/NsN environments. 

In the future work, we shall propose further NCONNs with multi-inputs and multi-outputs 
and apply them to the modeling and approximating problems of neutrosophic functions and NsN 
data, the clustering analysis of NsNs, medical diagnosis problems, and possible applications for 
decision-making and control in robotics [14,28] in an indeterminate/NSsN setting. 
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